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© An electronic board system has a reduced dis- 
play region (1c) at a lower portion of a writing screen 
(1a) on its electronic board (1), in addition to a non- 
reduced display region (1d). A character, an image 
such as a graphic, etc., and an edit command, 
written on the reduced display region (1c), can be 
entered into the electronic board system and they 
can be displayed on the non-reduced display region 
(1d) of the writing screen of the electronic board. 
Hence, the image displayed on the non-reduced 
display region (1d) can be recognized by other per- 
sons in front of the electronic board (1) without 
interference from a shadow of the writer and the 
electronic board (1) can be manipulated with readi- 
ness and at high precision by a person who cannot 
reach an upper portion of its writing screen (1a). 
Further, the sensors capable of sensing the traces of 
the image and so on are embedded in the rear of 
the writing screen (1a) so that the electronic board 
(1) can readily be moved and it can be prepared at 
reasonably cheap costs. The characters, images, 
edit commands, and so on written manually on the 
electronic board (1) with a pointing device (1b) can 
be recognized and the characters, images, etc., are 
edited on the basis of the recognized command. The 
results of recognition are then projected onto and 
displayed on the writing screen (1a) of the electronic 
board (1). 
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1 EPO 

BACKGROUND OF THE INVENTION 

The present Invention relates to an electronic 
board system so adapted as to recognize char- 
acters written as well as images, such as graphics 
and pictures, drawn on a screen of an electronic 
board and to display the results of recognition on 
the screen thereof by projecting it onto the screen 
thereof. 

It is general upon a meeting that the attendants 
discuss a preset issue on the basis of papers 
prepared in advance and/or information written on 
blackboard or whiteboard on site, they check the 
contents of the issue and amend them as needed, 
they record the conclusion or interim results, and 
they distribute a copy of the results of the meeting 
to the attendants and persons concerned. 

Electronic board systems are known as conve- 
nient means capable of facilitating the meeting. 
Such electronic board systems are disclosed, for 
example, in Japanese Patent Examined Publication 
(kokoku) No. 3-26,855 and Japanese Patent Unex- 
amined Publication (kokai) Nos. 2-200,499, 1- 
125,296, 63-209,999, and 62-52,630. 

The electronic board system as disclosed in 
Japanese Patent Examined Publication (kokoku) 
No. 3-26,855 is configured in such a manner that 
characters, graphics, etc. written or drawn on a 
screen of the electronic board system with and 
through a writing device with an oscillator equipped 
therein are detected as a sequence of data of 
coordinate positions through a sensor that is em- 
bedded in the electronic board; the sequence of 
the coordinate positions data is stored in image 
memory; the traces of the characters, graphics, etc. 
indicated by the sequence of the coordinate posi- 
tions data are displayed as the characters, graph- 
ics, etc. on a display screen; the sequence of the 
coordinate positions data existing in a given region 
is deleted from the corresponding image memory 
with and through a deleting device with an oscilla- 
tor equipped therein by performing operations for 
deleting the displayed coordinate positions data 
from the given region on a screen of the electronic 
board; and the characters, graphics, etc. displayed 
in the given region are deleted from the display 
screen. 

The electronic board system as disclosed in 
Japanese Patent Unexamined Publication (kokai) 
No. 2-200,499 is so arranged as to recognize char- 
acters, graphics, etc. written manually with a writing 
device on its board through a recognition process- 
ing device and to record the result of recognition 
on recording paper. 

Further, the electronic board system as dis- 
closed in Japanese Patent Unexamined Publication 
(kokai) No. 63-209,999 is configured in such a 
fashion that characters written manually are read 
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through an image reader and recognized with an 
OCR, and the result of recognition is displayed on 
a screen of the electronic board in an enlarged 
manner. 

5 In addition, the electronic board system as 
disclosed in Japanese Patent Unexamined Publica- 
tion (kokai) No. t -125,296 is so configured as to 
recognize voices entered in a voice recognition 
device as letters and display the words corre- 

w spending to the recognized voices on the screen of 
the electronic board. 

Furthermore, Japanese Patent Unexamined 
Publication (kokai) No. 62-52,630 discloses the 
electronic board system which is so configured as 

75 to recognize characters and graphics entered man- 
ually on a transparent graphics tablet device 
through a stylus input device and to display the 
result of recognition on a display device, such as a 
liquid crystal screen, integral with the graphics tab- 

20 let device. 

On top of those as described hereinabove, a 
device is proposed in an article entitled "A New 
Face of User Interface: Features of Two Big OSs 
for Input through Pens" (a magazine "Nikkei Byte", 

25 April, 1991, pages 233 to 238), which can translate 
particular traces of a pen on a graphics tablet 
device integral with a liquid crystal screen into edit 
commands and edit the corresponding image dis- 
played on the liquid crystal screen. 

30 Furthermore, as introduced in a leaflet of 
"Smart 2000 Series Products n of Smart Technol- 
ogy, Inc. in Canada, a data processing system is 
proposed which allows the user to perform all oper- 
ations in an interactive manner on a screen of the 

35 electronic board by recognizing characters, graph- 
ics, commands, etc. written through a pointing de- 
vice on the screen of the electronic board and 
projecting the result of recognition or the result of 
execution of the commands through an LCD pro- 

40 jector on the screen thereof and displaying it on a 
real time basis thereon. 

Those electronic board systems as described 
hereinabove, which are arranged to display the 
result of recognition through the voices or the re- 

45 suit of recognition through the OCR on the screen 
of the electronic board, suffer from the disadvan- 
tage that, although characters or graphics can be 
corrected on the electronic board, the result of 
correction cannot be recorded. 

so On the other hand, the electronic board sys- 
tems having the sensors embedded into the elec- 
tronic board or having the function of recognition 
added can record the result of correction; however, 
the former requires the use of the deleting device 

55 of a special type that is different from the pointing 
device so that it is laborious to distinguish the 
deleting device from the pointing device or vice 
versa, whenever characters, graphics, etc. are to 
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be deleted or written, and the latter requires the 
function of recognition on a large scale and the 
weight of the electronic board system becomes so 
heavy that it is very inconvenient to move the 
electronic board system to another place. 

Further, the device using the graphics tablet 
device with the liquid crystal screen is developed 
solely for use with an individual person so that a 
display device utilizing the graphics tablet device 
with the sensors and so on embedded therein and 
the liquid crystal screen, which requires precision 
processing, should be made larger in size and that 
the graphics tablet device should be integrated with 
the liquid crystal screen so that such electronic 
board system presents the problems that costs of 
manufacture become expensive, a quality may be- 
come instable, and it is difficult to move. 

In addition, for such electronic board systems 
of the Smart 2000 series as projecting onto the 
screen of the electronic board the display contents 
of a personal computer which is so designed as for 
an individual person to use while facing the display 
screen, they suffer from the disadvantages that 
complex and precise operations cannot be per- 
formed because a portion which a person writing 
on the electronic board shadows cannot be seen 
by the writing person itself and other persons and 
that the size and resolution of the electronic board 
cannot be utilized to a sufficient extent because 
some persons cannot reach and execute MENU 
commands or display data items, which are located 
at an upper portion of the electronic board. 

SUMMARY OF THE INVENTION 

Therefore, the object of the present invention is 
to provide an electronic board system that can be 
ready to move, that does not require a pointing 
device to be distinguished from an deleting device, 
that can be operated in a complex and precise 
fashion even if a person using the electronic board 
system could not reach the upper portion of the 
electronic board, and that can be prepared at low 
costs. 

In order to achieve the above-mentioned ob- 
ject, the present invention consists of an electronic 
board system comprising: 

a pointing device; 

a plurality of sensors for detecting a trace of a 
character, a graphic, or the like, written on a writing 
screen with said pointing device, which are embed- 
ded in the back of the writing screen; 

first storage means for storing the trace de- 
tected by said sensors as image data consisting of 
a sequence of coordinate data; 

recognition means for recognizing the char- 
acter, graphic, or the like written on the writing 
screen on the basis of the image data stored in 



said first storage means and for recognizing wheth- 
er the image data relating to a particular trace 
corresponds to either of a plurality of predeter- 
mined edit commands; 

5 second storage means for storing the recog- 

nized character, graphic, the recognized edit com- 
mand, and so on; 

command execution means for editing the rec- 
ognized character, graphic, or the like in accor- 

w dance with the edit command stored in said sec- 
ond storage means; and 

projection and display means for projecting 
and displaying the edited character, graphic, or the 
like onto the writing screen of the electronic board 

75 and for projecting and displaying the edited char- 
acter, graphic, or the like in a reduced form at a 
lower portion of the writing screen of the electronic 
board; 

wherein the character, graphic, or the like and 

20 the edit command to be represented in a reduced 
display region of the writing screen of the elec- 
tronic board and in a non-reduced display region 
thereof can be recognized one after another; and 
a display content to be displayed on the 

25 screen is updated one after another. 

The arrangement of the electronic board sys- 
tem as described hereinabove allows the char- 
acters, graphics, edit commands, and so on, written 
on the writing screen of the electronic board to be 

30 recognized by the recognition means and the char- 
acters, graphics, and so on to be edited in accor- 
dance with the recognized edit commands and the 
edited characters, graphics, and so on to be pro- 
jected and displayed on a non-reduced display 

35 region of the writing screen of the electronic board 
and at the same time to be projected and dis- 
played in a reduced form on a reduced display 
region located at the lower portion of the writing 
screen on the electronic board as well. Hence, 

40 even such a person as failing to reach the upper 
portion of the screen on the electronic board can 
perform complex and precise operations in the 
reduced display region to thereby utilize the size 
and resolution of the electronic board to a sufficient 

45 extent. Further, the electronic board system ac- 
cording to the present invention having the configu- 
ration as described hereinabove can be operated at 
the non-reduced display region of the writing 
screen on the electronic board as well as at the 

50 reduced display region thereof; hence, if the oper- 
ations would be performed only at the reduced 
display region of the writing screen, the non-re- 
duced display region thereof can be seen by other 
persons without causing the person handling the 

55 electronic board system to shadow the non-re- 
duced display region of the writing screen on the 
electronic board. 
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Further, the sensors are embedded in the back 
of the writing screen of the electronic board so that 
the electronic board system itself can be moved or 
carried without difficulty and the electronic board 
system can be prepared at low costs. 

In addition, such operations as deleting and so 
on can be executed in accordance with the edit 
commands so that any deleting device of a special 
type is not required, thereby improving operability. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a block diagram showing a first em- 
bodiment of the electronic board system according 
to the present invention. 

Figs. 2(a) and 2(b) are each a schematic repre- 
sentation showing an example in which a non- 
reduced display region and a reduced display re- 
gion are formed on the writing screen of an elec- 
tronic board and graphics are displayed on both of 
the non-reduced display region thereof and the 
reduced display region thereof. 

Fig. 3 is a flowchart showing procedures of 
processing to be performed by a data processor. 

Fig. 4 is a table showing logical data of results 
of recognition of image data. 

Fig. 5 is a flowchart showing a detail of proce- 
dures of processing a display of input image data. 

Fig. 6 is a schematic representation showing a 
process for converting data item entered in the 
reduced display region of the writing screen of the 
electronic board into a standard coordinate on the 
non-reduced display region thereof. 

Fig. 7 is a flowchart showing a detail of proce- 
dures of processing a display of recognized data. 

Fig. 8 is a schematic representation showing a 
process for converting a standard coordinate data 
item located on the non-reduced display region of 
the electronic board into a coordinate in the re- 
duced display region thereof. 

Figs. 9(a) and 9(b) are each a schematic repre- 
sentation showing an example in which input data 
is recognized. 

Figs. 10(a) and 10(b) are each a schematic 
representation showing an example in which DE- 
LETE command is executed. 

Fig. 1 1 is a table showing an example of edit 
commands. 

Figs. 12(a) and 12(b) are each a schematic 
representation showing an example in which MOVE 
command is executed. 

Fig. 13 is a block diagram showing a second 
embodiment of the electronic board system ac- 
cording to the present invention. 

Fig. 14 is a block diagram showing a third 
embodiment of the electronic board system ac- 
cording to the present invention, in which a plurality 
of graphics tablet units are connected. 



Fig. 15 is a block diagram showing a fourth 
embodiment of the electronic board system ac- 
cording to the present invention, in which an image 
reader such as a scanner or a facsimile machine is 
5 connected. 

Fig. 16 is a block diagram showing a fifth 
embodiment of the electronic board system ac- 
cording to the present invention, in which a voice 
recognition device is connected. 
to Fig. 17 is a diagram showing an input device 
management table to be used when a plurality of 
image input means are connected. 

Fig. 18 is a block diagram showing a sixth 
embodiment of the electronic board system ac- 
75 cording to the present invention, in which a plurality 
of electronic boards are connected with each other 
through data communication devices. 

Fig. 19 is a block diagram showing a seventh 
embodiment of the electronic board system ac- 
20 cording to the present invention, in which the elec- 
tronic board is connected with a television con- 
ference system, that is, a system to make a con- 
ference with persons at remote locations through 
the television conference system. 

25 

DESCRIPTION OF THE PREFERRED EMBODI- 
MENTS 

Fig. 1 is the block diagram showing the first 
30 embodiment of the electronic board system ac- 
cording to the present invention. The electronic 
board system comprises an electronic board 1, a 
data processor 2, a data storage 3, and a display 
unit 4. 

35 The electronic board 1 has a writing screen 1a 
of such a structure that a large number of sensors 
are arranged and embedded in a matrix form in the 
rear of the writing screen 1a so as to detect traces 
of characters, graphics, or the like, which are writ- 
40 ten on the writing screen 1a with a pointing device 
1b. 

The pointing device 1b may be prepared each 
for different colors or provided with a switch for 
selecting a color from the different colors, thereby 
45 capable of transmitting signals having different fre- 
quency of each of the different colors. On the other 
hand, the sensors are arranged so as to respond to 
the signals for each frequency to thereby distin- 
guish the pointing device 1b for each color from 
so the other pointing devices 1b, on the basis of the 
frequency transmitted from the pointing device 1b, 
and to thereby generate color data representing the 
color of the pointing device 1b that is being em- 
ployed and coordinate data lines, indicative of the 
55 traces of the pointing device 1b, as image data. 

The writing screen 1a of the electronic board 1 
may be of an overlap display type and of a tiled 
display type. The writing screen 1a of the overlap 
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display type may be divided into a non-reduced 
display region 1d and a reduced display region 1c, 
as shown in Fig. 2(a). On the other hand, the 
screen 1a of the electronic board of the tiled dis- 
play type may be divided as in a tiled form into a 
non-reduced display region 1d, a reduced display 
region 1c, and a non-display region le, for exam- 
ple, as shown in Rg. 2(b). The reduced display 
region 1c on the screen 1a of the electronic board 
1 is provided with the sensors at a density higher 
than the other regions on the screen 1a thereof, 
thereby allowing the image to be displayed clearly 
without fading when the image entered in the re- 
duced display region 1c is displayed in an en- 
larged form on the non-reduced display region 1d. 

The data processor 2 comprises an image data 
entry unit 21 for entry of image data generated 
from the electronic board 1 , an image data storage 
unit 22 for storing the image data entered into the 
image data entry unit 21 , an image data recognition 
unit 23 for recognizing characters, graphics, and so 
on written on the screen 1a on the basis of the 
image data stored in the image data storage unit 
22 and for recognizing the correspondence of the 
image data relating to a particular trace of the 
characters, graphics, or the like to either of a 
plurality of predetermined edit commands, a 
recognized-data storage unit 24 for storing the rec- 
ognized characters, graphics, graphics, edit com- 
mands, and so on, a recognition command execu- 
tion unit 25 for editing the recognized characters, 
graphics, graphics, and so on in accordance with 
the edit command stored in the recognized-data 
storage unit 24, and a stored-data display unit 26 
for supplying the display unit 4 through an image 
memory 27 with the edited characters, graphics, 
and so on, projecting and displaying them onto the 
non-reduced display region of the writing screen 1a 
of the electronic board 1 by the display unit 4, and 
projecting and displaying them in a reduced form 
onto the reduced display region located at a lower 
portion of the screen 1a. With the arrangement as 
described hereinabove, the data processor 2 is so 
configured as to recognize the characters, graph- 
ics, edit commands, and so on, to be written both 
in the reduced display region 1c of the writing 
screen 1a and in the non-reduced display region 
id thereof one after another to thereby update the 
display contents on the screen 1a thereof. 

The image data storage unit 22 comprises two 
storage unit sections one of which can bring image 
data into a readable state and the other of which is 
allowed to be brought into a writable state. While 
the image data is continuously written in the stor- 
age unit section in the writable state from the 
electronic board 1, the image data written in the 
previous input cycle is read from the other storage 
unit section in the readable state to thereby enter 



the image data into the image data recognition unit 
23. As the reading has been terminated, the stor- 
age unit section in the readable state is switched to 
the writable state and the other storage unit section 

5 in the writable state is switched to the readable 
state, thereby allowing the image data such as the 
characters, graphics, and so on, written in a man- 
ner asynchronous with processing for recognizing 
image data, to be supplied to the image data 

?o recognition unit 23 without losing them, by entering 
new image data from the electronic board 1 . 

The recognized-data storage unit 24 has like- 
wise two storage unit sections one of which is 
allowed to be brought into a readable state and the 

w other of which is allowed to be brought into a 
writable state. While the results of recognition of 
the image data are continuously written into the 
storage unit sections that is in the writable state, 
the recognized results of recognition are read in a 

20 previous recognition cycle from the other storage 
unit section in the readable state and entered into 
the recognition command execution unit 25. As the 
reading has been terminated, the states of the two 
storage unit sections are shifted, thereby switching 

25 the readable status of the storage unit section to 
the writable state and the previously writable status 
of the other storage unit section to the readable 
state. Consequently, new results of recognition can 
be written in the newly writable storage unit section 

30 to thereby provide the recognition command ex- 
ecution unit 25 with the results of recognition with- 
out losing them. 

The recognition command execution unit 25 
can read the result of recognition in the 

35 recognized-data storage unit 24 in the readable 
state in synchronization with a cycle of recognition 
by the image data recognition unit 23 and it can 
edit the result of recognition, such as the char- 
acters, graphics, and so on, in accordance with the 

40 edit command, when the edit command was de- 
tected in the read results of recognition, and store 
the edited newest image data in the data storage 3. 
On the other hand, if no edit command was de- 
tected in the read results of recognition, the read 

45 results of recognition such as the characters, 
graphics, and so on are stored intact in the data 
storage 3. Hence, the data storage 3 always stores 
the data corresponding to the newest image projec- 
ted and displayed on the screen of the electronic 

so board 1 so that the data stored in the data storage 
3 can be printed out with a printer when it is to be 
recorded on paper or the like. 

The stored-data display unit 26 is arranged to 
read the edited image data stored in the data 

55 storage 3 and to display it on the screen of the 
electronic board 1 through the display unit 4. The 
procedures of display on the electronic board 1 in 
this case are not restricted to a particular one and 
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they may involve projecting images onto a liquid 
crystal display unit through an overhead projector, 
projecting them through a projector, projecting 
them onto an opaque electronic board from the 
same direction in which the writer is present, or 
projecting them onto a transparent electronic board 
from the direction opposite to the direction in which 
the writer is present. 

The recognition processing to be performed by 
the image data recognition unit 23 is performed in 
accordance with conventional techniques so that a 
detailed description of the recognition processing 
will be omitted from the explanation that follows. 

Fig. 3 is the flowchart showing the procedures 
of the processing to be performed by the data 
processor 2. 

First, at step 301 , an image data entry device 
is selected for reading image data and entering it. 
The image data entry device may be so arranged 
as to read the image data through an image read- 
ing means, such as a scanner or a facsimile ma- 
chine, in such a manner as will be described 
hereinafter. In the first embodiment, the electronic 
board 1 is selected. 

Then, at step 302, the image data is entered 
through the image data entry unit 21, which is 
composed of a coordinate data line representing 
the traces of characters, graphics, or the like, writ- 
ten on the writing screen 1a of the electronic board 
1, and color data representing the color of the 
traces of the characters, graphics, or the like. Then, 
the image data is transferred directly to the display 
unit 4 through the image memory 27 and displayed 
on the screen 1a of the electronic board 1 prior to 
the execution of the recognition processing, while 
the image data is being stored one after another in 
the image data storage unit 22. 

Further, at step 303, the image data stored in 
the image data storage unit 22 is read one after 
another and supplied to the image data recognition 
unit 23 to thereby recognize the characters, graph- 
ics, edit command, and so on. 

The results of recognition obtained by the im- 
age data storage unit 22 are then stored in the 
recognized-data storage unit 24. More specifically, 
the results of recognition may be stored in the 
table, as shown in Fig. 4, showing the logical data 
of the results of recognition of the image data. The 
results of recognition are provided in units of the 
characters, graphics, and so on with identification 
numbers as the logical data and further classified 
by the kind such as a circle, a line of characters, a 
command, and so on, by the written position such 
as a central coordinate, so on, by the data such as 
the length of a radius of the circle, characters, and 
so on, and by the attribute information such as the 
kind of a line of the circle, the kind of a font, letter 
size, and so on. It can be noted herein that the 



attribute information on the DELETE command is 
represented by logical data ID# = 1, as shown in 
Fig. 4, so that the DELETE command is intended 
to mean the command for deleting the image of the 

5 circle having the ID #1. 

Hence, at step 304, the logical data stored in 
the recognized-data storage unit 24 is read by the 
recognition command execution unit 25 to thereby 
decide to determine whether the read logical data 

io contains the edit command, ff the result of decision 
indicates that the command is contained in the 
logical data, then the program flow goes to step 
305 at which the processing corresponding to the 
command is called to thereby edit the logical data 

75 such as the characters, graphics, and so on and to 
store the results of recognition in the data storage 
3. On the other hand, if it is decided that no 
command is contained in the read logical data, the 
logical data read from the recognized-data storage 

20 unit 24 are stored intact in the data storage 3. 

Then, at step 306, the edited image data 
stored in the data storage 3 is read by the stored- 
data display unit 26 and supplied to the image 
memory 27. Although at this time the image mem- 

25 ory 27 still stores unprocessed image data that has 
been entered through the image data entry unit 21 , 
the contents of the image memory 27 are overwrit- 
ten with the edited image data, that is, the image 
data prepared by converting the manually written 

30 characters, graphics, and so on into block letters or 
into normal forms. Then, the image data is dis- 
played on the screen of the electronic board 1 
through the display unit 4. 

It is then decided to determine if the display 

35 processing was over. When the result of decision 
indicates that the display processing is over, then 
the processes has been terminated. On the other 
hand, when it is decided that the display process- 
ing is not over yet, then the program flow returns to 

40 step 301 and the processes are repeated at step 
307 until an instruction to terminate the process is 
issued. 

More specifically, for example, when the point- 
ing device 1b is operated so as to write a circle 

45 201 and a square 202 in broken lines on the non- 
reduced display region 1d of the writing screen of 
the electronic board 1 as indicated in the display 
system of the overlap display type as shown in Fig. 
2(a), the circle 201 and the square 202 written in 

so solid lines are projected and displayed in the same 
positions and in the same sizes as those written in 
broken lines. At the same time, a circle 203 and a 
square 204, each having the same shape as those 
displayed on the non-reduced display region 1d 

55 yet having a reduced size, are projected and dis- 
played on the reduced display region 1c located at 
the lower portion of the screen 1a of the electronic 
board 1. 
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The characters, graphics, and so on can be 
written through the pointing device 1b on either of 
the reduced display region 1c or the non-reduced 
display region 1d of the screen 1a of the electronic 
board 1 . When they are written on the non-reduced 
display region 1d. they are written in their reduced 
sizes and shapes on the reduced display region 1c 
in the manner as described hereinabove. On the 
other hand, the characters, graphics, and so on 
written on the reduced display region 1c cannot 
further be reduced and displayed on the reduced 
display region 1c of the electronic board 1 as 
shown in Fig. 2(a); however, they can be displayed 
on the non-reduced display region 1d by transfer- 
ring their coordinates to the non-reduced display 
region 1d. 

Like on the screen of the overlap display type 
as shown in Fig, 2(a), the characters, graphics, and 
so on can be displayed in both of the non-reduced 
sizes and shapes as well as the reduced sizes and 
shapes on the so-called tiled screen as shown in 
Fig. 2(b). The non-display region 1e in the screen 
1a of the electronic board 1 as shown in Fig. 2(b), 
however, is so arranged as not to display any 
information of the characters, graphics, and so on. 

Fig. 5 is the flowchart showing the detail of the 
procedures of the image data display processing at 
step 302 as shown in Fig. 3. First, at step 500, the 
image data entered into the image data entry unit 
21 is displayed on the display unit 4. The manually 
written image is displayed intact on the writing 
screen 1a of the electronic board 1 in the position 
in which it was written. 

Then, at step 501 , it is decided to determine if 
a standard mode is set. The standard mode re- 
ferred to herein is intended to mean the mode in 
which no reduced display region 1c is disposed on 
the writing screen 1a of the electronic board 1. 
When it is decided that the standard mode is set, 
the image data entered from the screen 1a of the 
electronic board 1 is stored in the image data 
storage unit 22 without causing the coordinates of 
the image data to be processed. 

On the other hand, when a mode other than the 
standard mode is set, which is provided with the 
reduced display region 1c, it is decided at step 502 
to determine if the entered image data exists in a 
squared region of the reduced display region 1c, 
as shown in Fig. 6, enclosed by the starting point 
(c, 0) and the ending point (a, d). When the de- 
cision gives the result that the image data exists in 
the reduced display region 1c, that is, when it is 
decided that the pointing device 1b was operated 
in the reduced display region 1c, then it is decided 
that the input coordinates are to be corrected and 
the program flow goes to step 503 at which the 
linear form of the coordinates of the input image 
data is converted on the basis of the formulas (1) 



and (2) as follows: 

Formula (1): xa = [a/(a-c)] (xi - c) 

5 Formula (2): y 2 = (b/d)yi 

where xi and yi may be the x- and y-coordi- 
nates of the point written in the reduced display 
region 1c of Fig. 6 with the pointing device 1b; and 

70 X2 and y2 may be the standard x- and y- 
coordinates of the point converted by the formulas 
(1) and (2) above and transferred into the non- 
reduced display region 1d of the screen 1a of the 
electric board 1. 

75 For instance, when it is decided that the co- 
ordinates (xi, yi) of the point written with the 
pointing device 1b in the reduced display region 1c 
of the writing screen 1a of the electronic board as 
shown in Fig. 6, the coordinates are converted into 

20 the standard coordinates (X2, V2) in the non-re- 
duced display region 1d thereof through the for- 
mulas (1) and (2) above. 

To the contrary, when it is decided at step 502 
that the entered image data does not exist in the 

25 squared region as defined and delimited 
hereinabove, that is, when it is decided that the 
pointing device 1b is operated in the non-reduced 
display region 1d on the screen 1a of the electronic 
board 1 , the coordinates of the entered image data 

30 are stored intact in the image data storage unit 22. 
Hence, the image data storage unit 22 can always 
store the image data in the coordinate system of 
the non-reduced display region. 

A detailed description will now be made of the 

35 procedures of the recognized data display process- 
ing at step 306 in accordance with the flowchart as 
shown in Fig. 7. 

First, at step 701 , it is decided to determine if a 
standard mode is set which displays image data on 

40 a screen 1a having no reduced display region 1c. 
When the result of decision indicates that the stan- 
dard mode is set, on the one hand, then the 
program flow goes to step 703 at which the coordi- 
nates of the logical data stored in the data storage 

45 3 are converted into display signals without pro- 
cessing and they are displayed on the display unit 
4. 

On the other hand, when it is decided at step 
701 that a mode having the reduced display region 

50 1c, other than the standard mode, it is necessary to 
display the image in a reduced size and shape on 
the reduced display region 1c. Hence, in this case, 
it is decided to determine if the logical data stored 
in the data storage 3 exists in the reduced display 

55 region 1c, as shown in Fig. 8, enclosed by the 
starting point (c, 0) and the ending point (a, d). 
When the decision at step 701 gives the result that 
the logical data does not exist in the defined re- 
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gion, it is necessary to correct the coordinates of 
the logical data so that the program flow goes to 
step 702 at which the linear form of the coordinates 
of the logical data is converted on the basis of 
formulas (3) and (4) as follows: 

Formula (3): u 2 = [(a-c)/a]ui + c 

Formula (4): v 2 = (d/b)vi 

where ui and vi may be the x- and y-coordi- 
nates of the point written in the non-reduced dis- 
play region 1d of Fig. 8 with the pointing device 1b; 
and 

U2 and V2 may be the standard x- and y- 
coordinates of the point converted by formulas (3) 
and (4) above and transferred into the reduced 
display region 1c of the screen 1a of the electric 
board 1. 

For instance, when it is decided that the co- 
ordinates (ui, vi) of the point written with the 
pointing device 1b in the non-reduced display re- 
gion 1d of the writing screen 1a of the electronic 
board 1 as shown in Fig. 8, the coordinates are 
converted into the standard coordinates (U2, V2) in 
the reduced display region 1c thereof through the 
formulas (3) and (4) above. 

On the other hand, when it is decided at step 
702 that the logical data exists in the reduced 
display region 1c as defined and delimited 
hereinabove, the coordinates of the logical data are 
generated intact into the display unit 4. 

It should be noted herein that, when the loca- 
tion of the reduced display region 1c and the non- 
reduced display region 1d on the writing screen 1a 
of the electronic board 1 differ from those as 
shown in Figs. 6 and 8, the formulas for converting 
the linear forms of the image data and the logical 
data should be changed in accordance with the 
positions of the original points the direction of their 
coordinates and that the size, number and position 
of the reduced display region 1c may be set in an 
optional manner. 

A description will now be made of an example 
in which a circle, as indicated by reference numeral 
901, and characters "ABC", as indicated by refer- 
ence numeral 902, are written manually with the 
pointing device 1b in the reduced display region 1c 
on the writing screen 1a of the electronic board 1 
having an overlap-type display function as shown 
in Fig. 9(a). Fig. 9(b) shows an example in which 
the results obtained by processing the description 
contents as shown in Fig. 9(a) are displayed on the 
electronic board 1, that is, in which a circle 903 
representing the result of recognition of the man- 
ually written circle 901 and a line of characters 904, 
as indicated by "ABC", representing the result of 
recognition of the manually written line of char- 



acters "ABC" 902, are displayed in the reduced 
display region 1c. Further, a recognized circle 905 
and line of characters "ABC" 906 are displayed at 
the entire portion on the writing screen 1a of the 

5 electronic board 1 . 

Figs. 10(a) and 10(b) show an example of 
displaying an example in which the edit processing 
is executed with the edit command. Fig. 10(a) 
indicates an example of deleting circles 101 and 

ro 102 from the screen 1a of the electronic board 1 
by using DELETE command 103, as indicated by 
symbol "X", in the reduced display region 1c. Fig. 
10(b) indicates the result of executing the DELETE 
command 103 so that the circles 101 and 102 have 

75 been deleted from the screen 1a of the electronic 
board 1 as shown in Fig. 10(a), although the line of 
characters "ABC" remains stored and displayed on 
the writing screen 1a of the electronic board 1 . 
Fig. 1 1 shows an example of the table contain- 

20 ing the edit commands, such as deleting, moving, 
copying, and retrieving. A description will now be 
made of an example of moving the circle 102 to a 
predetermined position on the writing screen 1a of 
the electronic board 1 with reference to Figs. 12(a) 

25 and 12(b) by using the MOVE command as shown 
in Fig. 11. In this case, the circle 102 is enclosed 
as shown in Fig. 12(a) with a circular mark of the 
MOVE command as shown in Fig. 11 and the 
position to which the circle 102 is intended to be 

30 moved is specified by an arrow mark of the MOVE 
command. As a result, the circle 102 is transferred 
to the destination and displayed on the screen 1a 
of the electronic board 1 in the position specified 
by the MOVE command, as shown in Fig. 12(b). 

35 Likewise, the circle 101 displayed in the reduced 
display region 1c is transferred to and displayed in 
the reduced display region 1c in the position cor- 
responding to the destination of the circle 102 on 
the screen of the electronic board 1 as shown in 

40 Fig. 12(b). 

The electronic board system according to the 
embodiment of the present invention as described 
hereinabove can recognize the characters, graph- 
ics, edit commands, and so on, manually written on 

45 the writing screen 1a of the electronic board 1, 
through the image data recognition unit 23 and 
then edit the characters, graphics, and so on, on 
the basis of the recognized edit command as well 
as it can project and display the characters, graph- 

50 ics, and the like on the screen 1a thereof, while 
they are projected and displayed in their reduced 
sizes and shapes on the reduced display region 1c 
disposed at the lower portion of the screen 1a 
thereof. Hence, the operator who cannot reach the 

55 upper portion of the screen 1a can operate the 
electronic board 1 in a complex and precise fash- 
ion through the reduced display region 1c disposed 
at the lower portion of the screen 1a of the elec- 
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tronic board 1, thereby taking advantage of trie 
large size and high resolution of the electronic 
board 1 to a sufficient extent. Further, as the oper- 
ations can be made through either of the reduced 
display region 1c or the non-reduced display re- 
gion id, the writer does not shadow the non- 
reduced display region 1d when the writer operates 
this system through the reduced display region 1c, 
thereby allowing the audience to see the display 
contents without interference from the writer. 

In addition, the sensors are embedded in the 
back of the writing screen 1a of the electronic 
board 1 so that the electronic board system can be 
transferred to a different place without difficulty and 
it can be prepared at relatively low costs. 

Furthermore, the operations such as the delet- 
ing operation can be performed in accordance with 
the edit commands without the use of any special 
device for performing the delete processing, so 
that operability of the electronic board system can 
be improved to a high extent. 

When the characters, graphics, and so on are 
displayed in black and white, a variety of the edit 
processing can be performed with only one kind of 
the pointing device 1b without using different kinds 
of pointing devices. 

Further, touch sensors or optical sensors may 
be employed as the sensors for the electronic 
board 1, which are embedded in the back of the 
writing screen of the electronic board. 

In addition, one data processor 2 is so dis- 
posed as to correspond to one screen of the elec- 
tronic board 1 in this embodiment of the electronic 
board system according to the present invention. 
The electronic board system, however, may be 
arranged in such a structure that only one data 
processor 2 may correspond to a plurality of writ- 
ing screens of the electronic boards. In this case, 
the plural electronic boards 1 are disposed in a 
row. 

Now, a description will be made of the elec- 
tronic board system according to the second em- 
bodiment of the present invention as shown in Fig. 
13, which is provided with a data processor 2 
having a plurality of processors 210 to 213. The 
processor 210 comprises an image data entry unit 
21 and an image data storage unit 22; the proces- 
sor 211 comprises an image data recognition unit 
23 and a recognized-data storage unit 24; the pro- 
cessor 212 comprises a recognition command ex- 
ecution unit 25; and the processor 213 comprises a 
stored data display unit 26. Each of the processors 
210 to 213 is connected with each other and a data 
storage 3 through a data transmission line 214. It 
should be noted herein, however, that each of the 
units may be allocated to any processor as needed 
or that the processors and/or the units may be 
connected in any combination as needed. The 



combination of the units as in the second embodi- 
ment of the electronic board system according to 
the present invention can operatively manipulate 
data in the manner as described hereinabove. 

5 Fig. 14 shows the third embodiment of the 
electronic board system according to the present 
invention, in which a plurality of graphics tablet 
units 140 and 141 are connected to a data proces- 
sor 2, in addition to the electronic board 1. In the 

ro electronic board system of this embodiment, both 
of the electronic board 1 and the plural graphics 
tablet units 140 and 141 are connected with an 
input controller 142 that in turn is connected with 
the data processor 2. The data processor 2 may be 

75 configured in such a manner as the data processor 
2 used for the electronic board system of the first 
embodiment according to the present invention. 
The input controller 142 is so adapted as to select 
either one of the electronic board 1 or the tablet 

20 unit 140 or 141 and the image data generated from 
the selected device is stored in the image data 
storage unit 22 of the data processor 2. The image 
data entered from the tablet units 140 and 141 is 
subjected to the recognition processing in the man- 

25 ner as in the first embodiment, thereby displaying 
the entered image data on the screen 1a of the 
electronic board 1. 

The graphics tablet units 140 and 141 may be 
arranged in such a manner that one of the tablet 

30 units is so adapted as to enter image data written 
manually and the other is so adapted as capable of 
displaying the manually written image data. The 
arrangement of the tablet units allows the results of 
execution by the data processor 2 to be displayed 

35 on both of the electronic board 1 and the tablet unit 
having a display function. 

When the graphics tablet units 140 and 141 of 
such arrangement are placed nearby each of the 
attendants at a meeting, each of the attendants can 

40 take part in the meeting with the person using the 
electronic board 1 and the other attendants by 
amending what is written on the writing screen of 
the electronic board 1 by the writer and what is 
amended with the other attendants. This electronic 

45 board system can greatly serve as facilitating the 
meeting. 

Fig. 15 illustrates the electronic board system 
of the fourth embodiment according to the present 
invention, in which the image reader such as an 

so image scanner or a facsimile machine is connected 
with a data processor 2 with which the electronic 
board 1 in turn is connected. With the electronic 
board system according to the fourth embodiment 
of the present invention, an image reader 150 can 

55 read data 151, such as characters, graphics, pic- 
tures or the like, written or drawn manually with a 
writing device such as a pencil or a bail point pen, 
and transmit the read image data to a data proces- 
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sor 2 that processes the image data. The results of 
recognition of the image data to be made by the 
data processor 2 is then displayed on the screen of 
the electronic board 1 . 

The arrangement of the electronic board 1 con- 
nected with the image reader 150 can allow each 
of the attendants at a meeting to add an amend- 
ment to a draft memorandum, for example, for the 
meeting, displayed on the screen of the electronic 
board 1 through the image reader 150. Hence, this 
arrangement can facilitate the meeting to a great 
extent. 

Furthermore, a description will be made of the 
fifth embodiment of the electronic board system 
according to the present invention, in which a voice 
recognition device or a speech recognition device 
is connected with a data processor 2. The data 
processor 2 may comprise an image data entry 
unit 21, an image data storage unit 22, an image 
data recognition unit 23, a recognized-data storage 
unit 24, a recognition command execution unit 25, 
and a stored-data display unit 26, and each of the 
units may have substantially the same functions as 
those provided for the electronic board system 
according to the first embodiment of the present 
invention. With this arrangement of the electronic 
board system as shown in Fig. 16, voices are 
entered into a voice recognition device 160 through 
a microphone 161. The voice recognition device 
160 is so arranged as to recognize the correspon- 
dence of the input voices to words, graphics, edit 
commands, or the like and to transmit the results of 
recognition to the recognized-data storage unit 24 
of the data processor 2 for storing. When the edit 
commands are contained in the results of recogni- 
tion, the edit commands are executed by the rec- 
ognition command execution unit 25 of the data 
processor 2 to thereby display the result of execu- 
tion on the screen of the electronic board 1 . 

When the image data input means, such as the 
graphics tablet unit or the image reader, is con- 
nected with the plural data processors 2, in addi- 
tion to the electronic board 1, as shown in Figs. 14 
to 16, each of the data processors 2 may be 
arranged so as to manage each of the input de- 
vices on the basis of an input device management 
table 170 as shown in Fig. 17. 

The input device management table 170 con- 
tains data, such as the device identification num- 
bers for the input devices, the kinds of the devices, 
the addresses indicating the connection of the in- 
put devices with the processors, the status indica- 
tive of the current states of the input devices, the 
display modes indicative of the overlap display 
type, the tiled display type and the standard dis- 
play type, and the starting positions and the ending 
positions of the reduced display region. 



Fig. 18 shows the sixth embodiment of the 
electronic board system according to the present 
invention, in which a plurality of electronic board 
systems are connected with each other through a 

s plurality of data communication devices. As shown 
in Fig. 18, for example, an electronic board system 
1A having the same configuration as shown in Fig. 
1 is connected through a data communication de- 
vice 180 with a data transmission device 182, serv- 

io ing as a local area network or a global area net- 
work, with which an electronic board system 1B 
having the same configuration as shown in Fig. 1 is 
connected through another data communication de- 
vice 181. The image data can be exchanged be- 

75 tween the electronic board systems 1A and 1B 
disposed at remote locations so that a meeting can 
be held while exchanging the image written on the 
screen of the electronic board 1 between or among 
the electronic board systems disposed at remote 

20 locations. 

In addition, Fig. 19 shows the seventh embodi- 
ment of the electronic board system according to 
the present invention, in which the electronic board 
system is connected with a television conference 

25 system. As shown in Fig. 19, for example, a televi- 
sion conference system 1900 comprises a micro- 
phone 1901, a speaker 1902, a voice controller 
1903, a voice transmission unit 1904, a camera 
1905, an operation unit 1906, a monitor 1907, a 

30 graphic controller 1908, and an image transmission 
unit 1909. The television conference system 1900 
may be connected with another television con- 
ference system 1910 disposed at a different loca- 
tion via the data transmission unit 182 with which 

35 the interactive electronic board systems 1A and 
1B, each having a recognition function, as shown in 
Fig. 18, are connected through the data commu- 
nication devices 180 and 181, respectively. The 
arrangement of the electronic board systems and 

40 the television conference systems allows the data 
written on the screen of the electronic board 1 to 
be exchanged at remote locations during a meeting 
through a television set. 

As has been described hereinabove, the elec- 

45 tronic board systems according to the present in- 
vention comprises the pointing device, the plural 
sensors for detecting the traces of an image written 
on the screen with said pointing device, which are 
embedded in the rear of the screen; the first stor- 

50 age means for storing the traces of the image 
detected by said sensors as image data consisting 
of the sequence of coordinate data; the recognition 
means for recognizing the image written on the 
screen on the basis of the image data stored in 

55 said first storage means and at the same time for 
recognizing whether the image data relating to the 
particular traces corresponds to either one of a 
plurality of the predetermined edit commands; the 
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second storage means for storing the recognized 
image or the recognized edit command; the com- 
mand execution means for editing the recognized 
image in accordance with the edit command stored 
in said second storage means; and the projection 5 
and display means for projecting and displaying 
the edited image onto the writing screen of the 
electronic board and at the same time for projec- 
ting and displaying the edited image in the reduced 
form on a region disposed at the lower portion of jo 
the screen of the electronic board. Hence, the 
electronic board systems according to the present 
invention is adapted so as to recognize the image 
and the edit command to be represented in the 
reduced display region of the screen of the elec- 15 
tronic board and in the non-reduced display region 
thereof and to update the display content to be 
displayed one after another on the screen of the 
electronic board. Further, the electronic board sys- 
tems according to the present invention allows 20 
even the person failing to reach the upper portion 
of the screen of the electronic board to perform 
complex and precise operations through the re- 
duced display region located at the lower portion of 
the screen of the electronic board, thereby taking 25 
advantage of the large size and the high resolution 
of the electronic board. 

In addition, the electronic board systems ac- 
cording to the present invention offer the advantage 
that they can be operated through either one of the 30 
non-reduced display region or the reduced display 
region. Hence, when the electronic board system is 
operated through the reduced display region, the 
person writing the image on the reduced display 
region may not shadow the non-reduced display 35 
region so that the audience can see the image to a 
full extent through the non-reduced display region 
without interference from the writer. 

Further, the sensors are embedded in the rear 
of the screen of the electronic board so that the 40 
electronic board system can be moved or trans- 
ferred without difficulty and the electronic board 
system can be prepared at reasonably low costs. 

Furthermore, the electronic board systems ac- 
cording to the present invention allow the various 45 
operations to be performed through the edit com- 
mands, for example, the deleting operations, to be 
performed on the basis of a delete command, so 
that an operating device such as a deleting device 
of a special sort is not required, thereby improving 50 
operability. 

The electronic board systems according to the 
present invention can recognize the image data 
written on the screen of the electronic board as the 
logical data having the meaning for business of the 55 
user or as the command for the logical data and it 
can perform a variety of the operations of inserting, 
deleting, changing, printing, inspecting, transferring, 



saving, copying, and distributing, for example, to 
thereby display the results obtained by the various 
processing at real time on the writing screen of the 
electronic board. Hence, the electronic board sys- 
tems can further present the advantages, among 
others, that the meeting time and the times of the 
meeting can be reduced, quality of the meeting 
results can be improved, and expenses required for 
the meeting to be held with persons located at 
remote locations, such as travelling expenses and 
so on, can be reduced. 

In addition, the electronic board systems ac- 
cording to the present invention allow the recogni- 
tion processing to be changed in accordance with 
the business of each of the users so that the scope 
of application of the electronic board system can 
be expanded. 

Furthermore, the electronic board systems ac- 
cording to the present invention can improve effi- 
ciency in the meetings to be held between or 
among remote locations and reduce expenses re- 
quired for the meetings by connecting the plurality 
of the electronic boards with the data transmission 
device or the television conference systems. Fur- 
ther, the data processor for the electronic board 
system according to the present invention having 
the recognition processing function loaded thereon 
can be connected with an electronic board and/or a 
display unit of a conventional type, thereby readily 
realizing a system that is low at costs, high in 
quality, and easy to move or carry. 

Claims 

1. An electronic board system comprising: 

a pointing device (1b); 

a plurality of sensors for detecting a trace 
of a character, a graphic, or the like, written on 
a writing screen (1a) of an electronic board (1) 
with said pointing device (1b), which are em- 
bedded in the back of the writing screen there- 
of; 

first storage means (22) for storing the 
trace thereof detected by said sensors as im- 
age data consisting of a sequence of coordi- 
nate data; 

recognition means (23, 211) for recogniz- 
ing the character, the graphic, an edit com- 
mand or the like, written on the writing screem 
(1a) thereof, on the basis of the image data 
stored in said first storage means (22) and for 
recognizing whether the image data relating to 
a particular trace thereof corresponds to either 
of a plurality of preset edit commands; 

second storage means (24) for storing the 
recognized character, graphic, edit command, 
and so on; 

command execution means (25, 212) for 
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editing the recognized character, graphic, or 
the like on the basis of the edit command 
stored in said second storage means (24); and 
projection and display means (4) for pro- 
jecting and displaying the edited character, 5 
graphic or the like onto the writing screen (1a) 
of the electronic board (1) and for projecting 
and displaying the edited character, graphic or 
the like in a reduced form at a lower portion 
(1c) of the writing screen of the electronic 10 
board (1); 

wherein the character, graphic edit com- 
mand or the like to be represented in a re- 
duced display region (1c) of the writing screen 
(1a) of the electronic board (1) and in a non- is 
reduced display region (1d) thereof can be 
recognized one after another; and 

a display content to be displayed on the 
writing screen (1a) of the electronic board (1) 
is updated one after another. 20 

2. An electronic board system as claimed in 
claim 1. wherein said first storage means (22) 
is provided with switching means for selec- 
tively storing the image data read by an image 25 
data reader such as an image scanner (150) or 
a fascimile machine. 



the writing screen (1a) of the electronic board 
(1) at a density higher than in a non-reduced 
display region (1d) thereof. 



3- An electronic board system as claimed in 

claim 1 or 2, further comprising voice recogni- 30 
tion means (160) for recognizing input voice 
representing the character, graphic, edit com- 
mand or the like and for storing data relating to 
the recognized character, graphic, edit com- 
mand or the like in said second storage means 35 
(24). 

4. An electronic board system (11) as claimed in 
any one of claims 1 , 2 and 3, further compris- 
ing communication means (180, 181, 182) for 40 
sending and receiving the data stored in said 

first storage means or in said second storage 
means to or from another electronic board 
system (1 B). 

45 

5. An electronic board system (11) as claimed in 
any one of claims 1 to 4, further comprising 
communication means (180, 181, 182) for 
sending and receiving the data stored in said 

first storage means (22) or in said second 50 
storage means (24) to or from another elec- 
tronic board system (1B) in addition to data to 
be sent to or received from a television con- 
ference system (1900, 1910). 

55 

6. An electronic board system as claimed in any 
one of claims 1 to 5, wherein the sensors are 
disposed in a reduced display region (1c) of 
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